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Abstract. Two entropic dynamical models are considered. The geometric structure of the statistical 
manifolds underlying these models is studied. It is found that in both cases, the resulting metric 
manifolds are negatively curved. Moreover, the geodesies on each manifold are described by 
hyperbolic trajectories. A detailed analysis based on the Jacobi equation for geodesic spread is 
used to show that the hyperbolicity of the manifolds leads to chaotic exponential instability. A 
comparison between the two models leads to a relation among statistical curvature, stability of 
geodesies and relative entropy-like quantities. Finally, the Jacobi vector field intensity and the 
entropy-like quantity are suggested as possible indicators of chaoticity in the ED models due to 
their similarity to the conventional chaos indicators based on the Riemannian geometric approach 
and the Zurek-Paz criterion of linear entropy growth, respectively. 
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1. INTRODUCTION 

Entropic Dynamics (ED) [1] is a theoretical framework constructed on statistical mani- 
folds to explore the possibility that laws of physics, either classical or quantum, might 
be laws of inference rather than laws of nature. It is known that thermodynamics can 
be obtained by means of statistical mechanics which can be considered a form of sta- 
tistical inference [2] rather than a pure physical theory. Indeed, even some features of 
quantum physics can be derived from principles of inference [3] . Finally, recent research 
considers the possibility that Einstein's theory of gravity is derivable from general prin- 
ciples of inductive inference [4] . Unfortunately, the search for the correct variables that 
encode relevant information about a system is a major obstacle in the description and 
understanding of its evolution. The manner in which relevant variables are selected is not 
straightforward. This selection is made, in most cases, on the basis of intuition guided by 
experiment. The Maximum relative Entropy (ME) method [5, 6, 7] is used to construct 
ED models. The ME method is designed to be a tool of inductive inference. It is used 
for updating from a prior to a posterior probability distribution when new information 
in the form of constraints becomes available. We use known techniques [1] to show that 
this principle leads to equations that are analogous to equations of motion. Information 
is processed using ME methods in the framework of Information Geometry (IG) [8] that 
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is, Riemannian geometry applied to probability theory. In our approach, probability the- 
ory is a form of generalized logic of plausible inference. It should apply in principle, to 
any situation where we lack sufficient information to permit deductive reasoning. 

In this paper, we focus on two special entropic dynamical models. In the first model 
(EDI), we consider an hypothetical system whose microstates span a ID space labelled 
by the variables x\ e M"*" and X2 e M. We assume that the only testable information 
pertaining to the quantities xi and X2 consists of the expectation values {x\), (^2) and 
the variance /Sx2- In the second model (ED2), we consider a 2D space of microstates 
labelled by the variables G M and X2 G M. In in this case, we assume that the only 
testable information pertaining to the quantities x\ and X2 consist of the expectation 
values (jci) and {X2) and of the variances Axi and Ax2. Our models may be extended 
to more elaborate systems (highly constrained dynamics) where higher dimensions are 
considered. However, for the sake of clarity, we restrict our considerations to the above 
relatively simple cases. Given two known boundary macrostates, we investigate the pos- 
sible trajectories of systems on the manifolds. The geometric structure of the manifolds 
underlying the models is studied. The metric tensor, Christoffel connections coefficients, 
Ricci and Riemann curvature tensors are calculated in both cases and it is shown that in 
both cases the dynamics takes place on negatively curved manifolds. The geodesies of 
the dynamical models are hyperbolic trajectories on the manifolds. A detailed study of 
the stability of such geodesies is presented using the equation of geodesic deviation (Ja- 
cobi equation). The notion of statistical volume elements is introduced to investigate the 
asymptotic behavior of a one-parameter family of neighboring geodesies. It is shown 
that the behavior of geodesies on such manifolds is characterized by exponential insta- 
bility that leads to chaotic scenarios on the manifolds. These conclusions are supported 
by the asymptotic behavior of the Jacobi vector field intensity. Finally, a relation among 
entropy-like quantities, instability and curvature in the two models is presented. 



2. CURVED STATISTICAL MANIFOLDS 

In the case of EDI, a measure of distinguishability among the states of the system is 
achieved by assigning a probability distribution p(^\d^ to each state defined by ex- 

(1) (2) (2) 2 

pected values 0\ ' ,Q\ ' ,Q\' of the variables xi,X2 and {x2 — {X2)) . In the case of ED2, 
one assigns a probability distribution p{x\d^ to each state defined by expected values 

Qj^-*, Oj^"*, d'"^\ 9^2^ of the variables jci, (jci — (.^i))^, ^2 and {x2 — (^2))^- The process 
of assigning a probability distribution to each state provides the statistical manifolds of 
the ED models with a metric structure. Specifically, the Fisher-Rao information metric 
[9, 10, 11, 12] defined in (7) is used to quantify the distinguishability of probability dis- 
tributions p (x\6^ that live on the manifold (the family of distributions jp^^"^) (^\6^ | 

is as a manifold, each distribution p^'°'^ is a point with coordinates 6' where / 

labels the macrovariables). As such, the Fisher-Rao metric assigns an IG to the space of 
states. 



2.1. The Statistical Manifold J^Sx 



Consider an hypothetical physical system evolving over a two-dimensional space. The 
variables x\ e M"*" and ^2 G M label the ID space of microstates of the system. We assume 
that all information relevant to the dynamical evolution of the system is contained in the 
probability distributions. For this reason, no other information (such as external fields) 
is required. We assume that the only testable information pertaining to the quantities 
x\ and x-i consists of the expectation values (xi), (jC2) and the variance Ax2. Therefore, 
these three expected values define the 3D space of macrostates of the EDI model. 
Each macrostate may be thought as a point of a three-dimensional statistical manifold 

with coordinates given by the numerical values of the expectations 0^^^ 0^^^ q')^\ The 
available information can be written in the form of the following constraint equations. 



AX2 = ^((x2-(x2)f) = [j^:dX2 ix2 - {x2)f P2 (x2\6f\ df) 



(1) 



where = (xi), Q^^' = (x2) and = ^2- The probability distributions p\ and p2 
are constrained by the conditions of normalization. 



,(2) 



,(2) 



l^'^dxipi {xi\d['^^ = 1, jydX2P2 (X2\df\ ) 



(2) 



Information theory identifies the exponential distribution as the maximum entropy dis- 
tribution if only the expectation value is known. The Gaussian distribution is identified 
as the maximum entropy distribution if only the expectation value and the variance are 

known. ME methods allow us to associate a probability distribution p^'"'"! (x\0^ to each 

point in the space of states. The distribution that best reflects the information contained 
in the prior distribution m (x) updated by the constraints {{xi), {X2), ^2) is obtained by 
maximizing the relative entropy 
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where m{x) = m is the uniform prior probability distribution. The prior m is set to 

be uniform since we assume the lack of initial available information about the system 
(postulate of equal a priori probabilities). Upon maximizing (3), given the constraints 
(1) and (2), we obtain 



p^^-)(x\e)=p,(x,\e^^)p2{x2\ef\ef) = ^ 



1 _i 

e ''1 

Ml 



(4) 



where 0\ = ji^, 0\ = and O2 = 02- The probability distribution (4) encodes the 
available information concerning the system and becomes, 

{1-^1 1 (-^2-^2)^ 
p^'^'Uxle) = —e~^i^^=e ^"2 ■.xeR+ xW scad e = {111,112,02) >■ 
^ ^ ^\ J 

(5) 

Note that we have assumed uncoupled constraints between the microvariables x\ and 
X2. In other words, we assumed that information about correlations between the mi- 
crovariables needed not to be tracked. This assumption leads to the simplified product 
rule in (4). Coupled constraints however, would lead to a generalized product rule in 
(4) and to a metric tensor (7) with non-trivial off-diagonal elements (co variance terms). 
Correlation terms may be fictitious. They may arise for instance from coordinate trans- 
formations. On the other hand, correlations may arise from interaction of the system 
with external fields. Such scenarios would require more delicate analysis. 



2.7.7. The Metric Tensor on 



We cannot determine the evolution of microstates of the system since the available 
information is insufficient. Instead we can study the distance between two total distribu- 
tions with parameters (/ij,/i2, 02) and (/ij + JjU^, jU2 + <^M2' Oi-^d02)- Once the states 
of the system have been defined, the next step concerns the problem of quantifying the 
notion of change in going from the state Q to the state + J0. For our purpose a conve- 
nient measure of change is distance. The measure we seek is given by the dimensionless 
"distance" ds between and /7(x|0 + 



(6) 



where 



(7) 



is the Fisher-Rao information metric. Substituting (4) into (7), the metric gij on 
becomes, 

/ ^ \ 

^ 1 
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Substituting (8) into (6), the "length" element reads. 



112 
(^*^) ^ = —d^^^ + —dill + —dol. 



(9) 



Notice that the metric structure of is an emergent structure and is not itself fun- 
damental. It arises only after assigning a probability distribution p {x\ to each state 

— * 

e. 



2.1.2. The Curvature of 



In this paragraph we calculate the statistical curvature Rj{^^ ■ This is achieved via 
application of standard differential geometry methods to the space of probability distri- 
butions • Recall the definitions of the Ricci tensor Rij and Riemann curvature tensor 
Ra\jLVp-> 

Rij = g^'^Raibj = dkT'ij - djV'^k + ^h^kn - ^Tk^M^ (10) 

and 

The Ricci scalar R^^^ is obtained from (10) or (1 1) via appropriate contraction with the 
metric tensor gij in (8), namely 

R = Rijg'j = Rap,SS"h^^ (12) 



where g^'^gkj = 5} so that g'j = [gij) ^ = diag{il\, G^, ^). The Christoffel symbols F^^ 
appearing in (10) and (II) are defined by, 

= {digmj + djgim - dmgij) • (13) 

Substituting (8) into (13), we calculate the non-vanishing components of the connection 
coefficients, 

pi -_ ^ p3 _ ^ p3 __ 1 p2 _p2 __ 1 (^.^ 
Hi 2.02 02 02 

By substituting (14) in (10) we determine the Ricci tensor components, 

I „ I 

> ^33 = 

^2 <^2 

The non- vanishing Riemann tensor component is. 



i?ll=0,i?22 = -T-^,^33 = 2- (15) 



Ri-m = J- (16) 

<^2 



Finally, by substituting (15) or (16) into (12) and using (g;y) ^ we obtain the Ricci 
scalar, 

=-l<0. (17) 
From (17) we conclude that is a manifold of constant negative (—1) curvature. 



2.2. The Statistical Manifold J^s^ 



In this case we assume that the ID space of microstates of the system is labelled by 
the variables xi e M and X2 G M. We assume, as in subsection (2.1), that all information 
relevant to the dynamical evolution of the system is contained in the probability distribu- 
tions. Moreover, we assume that the only testable information pertaining to the quantities 
x\ and X2 consist of the expectation values (xi) and {xi) and of the variances Axi and 
tsX2. Therefore, these four expected values define the 4Z) space of macrostates of 
the ED2 model. Each macrostate may be thought as a point of a four-dimensional statis- 
tical manifold with coordinates given by the numerical values of the expectations , 

02^^ 02^^. The available information can be written in the form of the following 
constraint equations, 

(j^l) = ^-ZdxiXipi {x\\Qf'^ , {X2) = J^^dX2X2P2 (x2\9f\ Of^^ , 



Ax] 



{xi-{xi)y 



'dxi {xi - {x])fpi (xi\d^p, 



(18) 



AX2 = ^((;C2-(;C2))') = [/+r^^2 (^2 - {X2)fp2 (x2\dfK ) 



where Q^^^ = {xi), Oj^^ = Axi, = (^2) and Oj^^ = Ajc2. The probability distributions 
pi and p2 are constrained by the conditions of normalization, 

l^°°dxipi (xi\e^'\ 0^')) = 1, j^°^dx2P2 (x2\ef\ ) = i. (i9) 

The distribution that best reflects the information contained in the uniform prior distri- 
bution m{x) =m updated by the constraints {{x\), Axi, {x2), ^2) is obtained by maxi- 
mizing the relative entropy 
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m 



(20) 



Upon maximizing (20), given the constraints (18) and (19), we obtain 



2a? 



(^2-|"2) 



2<ji 



(21) 



The probability distribution (21) encodes the available information concerning the sys- 
tem and becomes, 



(^l-Ml) 1 fe-|"2) 



= ^p(^^^)(jc|0j= ^ e =g ^^:xeKxMand0 = (Mi,<Ti,Ai2><y2) 

(22) 



2.2.1. The Metric Tensor on 
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Proceeding as in (2.1.1), we determine the metric on ^^j- Substituting (21) into (7), 
the metric gij on becomes. 
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Finally, substituting (23) into (6), the "length" element reads, 



'■S2 



^1 ^1 ^2 ^2 



(23) 



(24) 



2.2.2. The Curvature of 



Proceeding as in (2.1.2), we calculate the statistical curvature R,^^^^ of ^^2- Notice 

that g^^ = [gij) ^ = diag{o\, o\, ^). Substituting (23) into (13), the non-vanishing 
components of the connection coefficients become. 



1-1 _ 1-1 _ 1 1-2 _ 1 1-2 _ 1 1-3 _ 1-3 _ 1 1-4 _ 1 1-4 _ 
i 12 — i 21 — ~ — ' ^ 22 — ~ — ' ^ 11 — TZT' i 34 — ^ 43 — ^ 33 — TZT' 44 — ~ — 



By substituting (25) in (10) we determine the Ricci tensor components. 



1 

^2 

(25) 



= = "if' = = "if- ^^^^ 

The non-vanishing Riemann tensor components are, 

1 1 

-^1212 = 4 , -^3434 = 4 • (27) 



Finally, by substituting (26) or (27) into (12) and using (g/y) \ we obtain the Ricci 
scalar, 

R^^^ = -2 < 0. (28) 
From (28) we conclude that J!^S2 is a manifold of constant negative (—2) curvature. 

3. THE ED MODELS 

The ED models can be derived from a standard principle of least action (Maupertuis- 
Euler-Lagrange-Jacobi-type) [1, 13]. The main differences are that the dynamics being 
considered here is defined on a space of probability distributions not on an ordinary 
linear space V. Also, the standard coordinates qj of the system are replaced by statistical 
macro variables 

Given the initial macrostate and that the system evolves to a fixed final macrostate, 
we investigate the expected trajectories of the ED models on and .^sj- It known 
[13] that the classical dynamics of a particle can be derived from the principle of least 
action in the Maupertuis-Euler-Lagrange-Jacobi form, 

5/jacobi [q] = 5 ds^ {qj, ^,s,H^=0, (29) 

where qj are the coordinates of the system, s is an affine parameter along the trajectory 
and ^ isa functional defined as 

For a non-relativistic system, the energy H is, 

H = T + U{q) = Wajk (q) qflk + U (q) (31) 

where the coefficients aji^ are the reduced mass matrix coefficients and q = ^ is, the 
time derivative of the canonical coordinate q. We now seek the expected trajectory of 
the system assuming it evolves from d'^j^ = 6^ = {ji^ (si) , (si) , 02 (si)) to 6 new = 
6^ + dO^ = (jU 1 f) , {s f) , (72 (5/) ) . It is known [1] that such a system moves along 
a geodesic in the space of states, which is a curved manifold. Since the trajectory of the 
system is a geodesic, the ED-action is itself the length; that is, 

I 

Jed [6] = J K) ^ = / (gijddW) ^ = J^s (^O'^^^) ' ^ ['ds^ie^B) 

(32) 

where = ^ and =Sf (0, 0) is the Lagrangian of the system. 



(33) 



A useful choice for s is one satisfying the condition gij^^ = 1- Therefore, we 
formally identify the affine parameter s with the temporal evolution parameter z, s = z. 
Performing a standard calculus of variations with 5 = t, we obtain 

5JED[d]^ I^tI j50^ = O,V50^ (34) 



Note that from (34), ^ = j^e'd^. This differential equation shows that if = 

for a particular k then the corresponding 6^ is conserved. This suggests to interpret 6^ 
as momenta. Equations (34) and (13) lead to the geodesic equation, 

— r4^+rf;— 7^— 7^ = 0. (35) 
dx^ ■' dx dx 

Observe that (35) are nonlinear, second order coupled ordinary differential equations. 
These equations describe a dynamics that is reversible and their solution is the trajectory 
between an initial and a final macrostate. The trajectory can be equally well traversed in 
both directions. 



3.1. The EDI: Geodesies on ^< 



•^1 



We seek the explicit form of (35) for EDI. Substituting (14) in (35), we obtain. 



d^jli 1 [djl^\^ d^iJ.2 2 dil2d02 d^02 1 



dx"^ lii\dxj ' dx'^ 02 dx dx ' dx^ 02 

Integrating this set of differential equations, we obtain 

jUj (t) =A\ [cosh(aiT)-sinh(ociT)] 



d02 

dx 



1 / J/i^ 



2\ dx 



(36) 



cosh(2j8 1 t) -sinh(2j8 1 t) + -4j 



+ Ci, 02{x)^Bv 



[cosh(j3 1 t) - sinh( j8 1 t) 



n2 > 



cosh(2j3 1 t) - sinh(2j8 1 t) + -4- 



(37) 



aA2 



where A\, B\, C\, a\ and are real integration constants (5 = 6—1, [OjO 

1) . The set of equations (37) parametrizes the evolution surface of the statistical 
submanifold m^^ of ^^j. 



m. 



= jp^'"') {x\d^ e^si'.e satisfy (36)} , 



(38) 



3.2. The ED2: Geodesies on J^, 



We seek the explicit form of (35) for ED2. Substituting (25) in (35), we obtain. 



cJi di di ' dx'^ 



J_ 

<7l 



9 9 

doi \ _l( dUi ^ 



dx 



dx 



2 diX2 da2 d'^G2 _ J_ 
(72 dx dx ' dx'^ ~ 02 



\dx ) 

Integrating this set of differential equations, we obtain 



(39) 



Mi(t) 



42 
^2 



2a2 



cosh(2a2T)-sinh(2a2'r)+^ 

o(X', 



^+Ci, (7i(t)=A2 



[cosh(a2T)— sinh(a2T)] 



cosh(2a2l^)-sinh(2a2T)+--^ 

oCCr, 



M2(t) 



cosh(2j82T)-sinh(2j32T)+-^ 



^+C2, C72(t)=52 



[cosh ( J3 2 t) - sinh ( jS 2 t) ] 
cosh(2j32T)-sinh(2j32T)+- 



(40) 

where A2, B2, C\, C2, OC2 and P2 ^^'^^ integration constants. The set of equations (40) 
parametrizes the evolution surface of the statistical submanifold of ^^2' 



S2 



= jp^'"') (x\e^ e ^S2- ^ satisfy (39)} . (41) 



4. CHAOTIC INSTABILITY IN THE ED MODELS 

It is known that [13] the Riemannian curvature of a manifold is closely connected 
with the behavior of the geodesies on it, i.e., with the motion of the corresponding 
dynamical system. If the Riemannian curvature of a manifold is positive (as on a 
sphere or ellipsoid), then the nearby geodesies oscillate about one another in most cases; 
whereas if the curvature is negative (as on the surface of a hyperboloid of one sheet), 
geodesies rapidly diverge from one another. 



4.1. Instability in EDI 

In this subsection, the stability of EDI is considered. It is shown that neighboring 
trajectories are exponentially unstable under small perturbations of initial conditions. In 
the rest of the paper, for the sake of simplicity, we assume that Ai = Bi = A2 = ^2 = A, 
Ci = C2 = and ai=j8i = a2 = j82 = ot. Our conclusions do not depend on the 
particular initial conditions chosen. 



4.1.1. The Geodesic Length 



-1 ju=1.2,3 



aeM.+ 



Consider the one-parameter family of geodesies =^g^^j (^) = {^!#s ('^;^)| 
where are solutions of (36). The length of geodesies in ^g^^^ (of) is defined as 

T 

®J(., (t; a)^^ ^ {gijdd'ddjy ^ I 



1 



1 

dz'. 



(42) 

Substituting (37) in (42) and considering the asymptotic expression of (r; a), we 
obtain 

0.^,, (-z^ a) = ©1 (t; a) ^ v^ar. (43) 

In order to investigate the asymptotic behavior of two neighboring geodesies labelled by 
the parameters a and a + 5a, we consider the following difference, 

A01 = |0i (t; a + 5a)- 0i (t; a)| = v^|5a| t. (44) 

It is clear that A0i diverges, that is, the lengths of two neighboring geodesies with 
slightly different parameters a and a + 5a differ in a remarkable way as the evolution 
parameter t — > oo. This hints at the onset of instability of the hyperbolic trajectories on 



4.1.2. The Statistical Volume Elements 

The instability of EDI can be further explored by studying the behavior of the one- 
parameter family of statistical volume elements ^v^^ (Cf) = l^.^v, ("^^ cu)| . Recall 

that is the space of probability distributions p^^°^^ {^\^ labeled by parameters 

©2^^ These parameters are the coordinates of the point p^^°^\ and in these 
coordinates a 3D volume element dVj^^^ reads 

dVj^,^ = ^dQ^-}dQfdQf = ^diiidii2dG2, (45) 

where in the EDI model here presented, g = | det [gij) ^ \ = j^r^- Hence, the volume 
element dV^^^ is given by. 



V2 

dV^^^ = ^dn^dii2d02. (46) 

^\^2 



The volume of an extended region of is defined by. 



(0) /ii(0)/i2(0)(J2(0) 



Integrating (47) using (37), we obtain 



(47) 



^ ar InA InA 

The quantity that actually encodes relevant information about the stability of neighbor- 
ing volume elements is the the average volume ( AV^ 



ax InA ^ctT^ InA 



y2a2 

(49) 

For convenience, let us rename (aVj^^^ ^ = AVi. Therefore, the asymptotic expansion 
of AVi for T ^ oo reads, 

AKi ^ -^e""'. (50) 

This asymptotic regime of diffusive evolution in (50) describes the exponential increase 
of average volume elements on ■ The exponential instability characteristic of chaos 
forces the system to rapidly explore large areas (volumes) of the statistical manifolds. 
It is interesting to note that this asymptotic behavior appears also in the conventional 
description of quantum chaos [14] where the entropy increases linearly at a rate deter- 
mined by the Lyapunov exponents [15] . The linear entropy increase as a quantum chaos 
criterion was introduced by Zurek and Paz. In our information-geometric approach a 
relevant variable that will be useful for comparison of the two different degrees of in- 
stability characterizing the two ED models is the relative entropy-like quantity defined 
as, 

5i=ln(AVi). (51) 
Substituting (50) in (51) and considering the asymptotic limit T — > oo, we obtain 

^1 f» ax. (52) 

The entropy-like quantity 5i in (52) may be interpreted as the asymptotic limit of the 
natural logarithm of a statistical weight ^AV^^^ ^ defined on ./^^^ . Equation (52) is the 
information-geometric analog of the Zurek-Paz chaos criterion. 



4.1.3. The Jacobi Vector Field Jj^^^ 



We study the behavior of the one-parameter family of neighboring geodesies 

A2 1 



Q^{x\a) = (t; a) =Ae"^, 0^(t; a) = jLi2(T; a) 



2a p-2ax I 

^ ^ 8c? 



(53) 



e^{T,a) = c72(t;oc)=A- 



,-2CI!T I A\ 



The relative geodesic spread is characterized by the Jacobi equation [16, 17], 

-'-(^^•U,.JJl^4ee''^o (54) 



Dt2 "'^^ dx dx 



where / = 1, 2, 3 and. 



5e^^5ae^'^{^-^^^f 5a. (55) 

Equation (54) forms a system of three coupled ordinary differential equations linear 
in the components of the deviation vector field (55) but nonlinear in derivatives of the 
metric (8). It describes the linearized geodesic flow: the linearization ignores the relative 
velocity of the geodesies. When the geodesies are neighboring but their relative velocity 
is arbitrary, the corresponding geodesic deviation equation is the so-called generalized 
Jacobi equation [18]. The nonlinearity is due to the existence of velocity-dependent terms 
in the system. 

Neighboring geodesies accelerate relative to each other with a rate directly measured 
by the curvature tensor RapjS- Multiplying both sides of (54) by gij and using the 
standard symmetry properties of the Riemann curvature tensor, the geodesic deviation 
equation becomes. 

Recall that the covariant derivative ' in (54) is defined as, 

= l-2r \-V 8 \-V 5-1- 

Dt2 Jt2 ^ ^ a/3 ^ ap,v 

^'cc^^P^^dT dx^ ^^'^ 



and that the only non-vanishing Riemann tensor component is i?2323 = — \- Therefore, 
the three differential equations for the geodesic deviation are, 

2 

56^=0, (58) 



+ 2 



23' 



deU{50^) ^de^d{5d^) 



1 



dd^dd^ 



g22 AT 



dT dx 



1 



■+r: 



32- 



dx dx 



+ <^3r23 



50 ^2323 

g22 



dd^ 
'dx 



56' 



dO 
dx 



3x 2 



56^ +rl2^lj, 



dd^ 
dx 



50' 



(59) 



£{56^ 
dx^ 



+ 2 



^3 d9^d{5d^) 3 deU{5e^) 



22' 



33' 



dx 
5d\ 



dO 
'dx 



3^ 2 



2x 2 



1 „ de^de\^2 1 „ 

= °2323-J 1— Jt2323 -J- 

Substituting (14), (16) and (53) in equations (58), (59) and (60) and considering the 
asymptotic limit T — > oo, the geodesic deviation equations become. 



d^(5d^) d(5e^) . 1 

\ ^ ^ +2a ^ , ^ +a^5e^ = 0, 
dx"^ dx 



dx^ 



dx 



dx 



8a^ 



(61) 



503 = 0, (62) 



J2(503) J(503) / 2 32a4_2„A^. 8a2 _^,J(502) 8a3 . ^ 

— ^^H^+2a— ^ ^+ 50"* e ^ ^ e "^50^ = 0. 

dx^ dx \ J A dx A 



(63) 

Neglecting the exponentially decaying terms in 50^^ in (62) and (63) and assuming that, 



lim 

X — yoQ 



0, lim ; 



-ax 



J (502) 



A dx I T-»°° y A dx 

the geodesic deviation equations finally become. 



:0,lim ; 

T-»oo V A 



0, 



(64) 



i/2(50i) J(50i) . , d^(50^) d(50^) . . 



— V^+2a \ ^ +a^de^ = 0. 



dx 



(65) 



(60) 



Note that in order to prove that our assumptions in (64) are correct, we will check a 
posteriori its consistency. Integrating the system of differential equations (65), we obtain 



5/ii(T) = {ai+a2T)e 5jU2 (t) = (^3 + a4T)e "'^ - -^05^ ^"'^ + ^6, (66) 
5a2(T) = {a2+a4T)e' 



-az 



where at, i = 1,..., 6 are integration constants. Note that conditions (64) are satisfied and 
therefore our assumption are compatible with the solutions obtained. Finally, consider 
the vector field components = 56'^ defined in (55) and its magnitude J, 

fi = fji = gijfP. (67) 
The magnitude J is called the Jacobi field intensity. In our case (67) becomes, 

A =-^(5Mi)V;^(5Ai2)V;^(5a2)^ (68) 

' Ml <^2 

Substituting (53) and (66) in (68), and keeping the leading term in the asymptotic 
expansion in , we obtain 



'■C^,,e"\ (69) 



Aal 



where the constant coefficient C^^^ — 2y4a ^^^'^^^^ information about initial conditions 
and depends on the model parameter a. We conclude that the geodesic spread on 
is described by means of an exponentially divergent Jacobi vector field intensity 
J^^^ . It is known that classical chaotic systems exhibit exponential sensitivity to initial 
conditions. This characterization, quantified in terms of Lyapunov exponents, is an 
important ingredient in any conventional definition of classical chaos. In our approach, 

the quantity ps; i lim In 4^ with / given in (69) would play the role of the 



7(0) 

conventional Lyapunov exponents 



4.2. Instability in RED2 



In this subsection, the instability of the geodesies on is studied. We proceed as in 
subsection (4.1). 



4.2.1. The Geodesic Length 



At=l,2,3,4 



Consider the one-parameter family of geodesies ^Gj(^^ (^) = | ('^^ ^) | 
where are solutions of (39). The length of geodesies in ^g^^^ (of) is defined as. 



(70) 

Substituting (40) in (70) and considering the asymptotic limit of j^^^ (r; a) when 
T — > oo, we obtain. 



0^,2 ^-z^ ^ = ®2 (t; a) 2aT. (71) 

In order to investigate the asymptotic behavior of two neighboring geodesies labelled by 
the parameters a and a + 5a, we consider the following difference, 

A02= |02(t; a + 5a)-02(T; a)| =2|5a|T. (72) 

It is clear that A02 diverges, that is the lengths of two neighboring geodesies with 
slightly different parameters a and a + 5a differ in a significant way as the evolution 
parameter t — > oo. This hints at the onset of instability of the hyperbolic trajectories on 



4.2.2. The Statistical Volume Elements Vj^^^ 

The instability of ED2 can be explored by studying the behavior of the one-parameter 
family of statistical volume elements (a) = <^ (t; a) \ . Recall that is 

the space of probability distributions p^^"^) {x\Q^ labeled by parameters d^^\ ^2^^ d^^\ 

These parameters are the coordinates of the point p^^'^^\ and in these coordinates a 
4D infinitesimal volume element dV reads, 

dYj(^^ = ^dQ^l^ dQ^^^ dQ^^^ dQ^^^ = y/gdii^dOidii2d02, (73) 

where in the ED2 model here presented, g = I det (gij) ^ \ = —r^. Hence, the infinites- 
imal volume element dVj^^^ is given by, 

2 

dVj^ = ^^dnidaidii2d02. (74) 



The volume of an extended region of is defined by. 



V^,^{0) Ml(0)C7i(0) M2(0)CT2(0) 



(75) 

Integrating (75) and using (40), we obtain 

AV^., = 5^^-'-55.. (76) 

The average volume on is (aV^^^ ^ , 





AV^.,)^^'i/AV^.,(x';a)rfx'=^f?!!-^ (77) 



For convenience, let us rename (^AV^^^ j = AV2. Therefore, the asymptotic expansion 
of AV2 for T ^ 00 reads, 

a2 „2ax 

Ay2~;r3 • (78) 



In analogy to (51) we introduce. 



52 = ln(Ay2). (79) 



Substituting (78) in (79) and considering its asymptotic limit, we obtain 

^2 ^ lax. (80) 



4.2.3. The Jacobi Vector Field J^^^ 

We proceed as in (4.1.3). Study the behavior of the one-parameter (a) family of 
neighboring geodesies on ^S2' ('^J ^)}j=i 234 

03 (T;a) ^ 0i (T;a) = (t;«) = ^ > (81) 

04 (t; a) = 02 (t:; a) =A (82) 

Note that because we will compare the two Jacobi fields Jj^^^ on and 7^^^ on ^S2^ 
we assume the same initial conditions as considered in (4.1.3). Recall that the non- 
vanishing Riemann tensor components arei?i2i2 — —\ and 7^3434 = — \ given in (27). 



Therefore two of the four differential equations describing the geodesic spread are. 



+ 2 



,1 dd^d{5e^) , dd^d{5e^) 



12' 



dx dx 



+r 



21 



1 d^'dB\^ 1 

^^1212-; ^1212 

gn dx dx gn 



dO 
dx 



dx dx 

2x 2 



+ d2r\2 



dd^ 
dx 



dd^ 
dx 



5e\ 



56' 



(83) 



d^[5d^) 
dx^ 



+ 2 



ir 



de^d{5d^) 2 d0^d{de^) 



dx dx 



+r: 



22' 



^^1212-} —Ot) «1212 

g22 dx dx g22 



dd 
'dx 



dx dx 

ix 2 



+ d2Tl2 



dd^Y ^^2 , T-2 T-1 ^^^^^[§q1 



dx 



dx dx 



56' 



The other two equations can be obtained from (83) and (84) substituting the index 
1 with 3 and 2 with 4. Thus, we will limit our considerations just to the above two 
equations. Using equations (25), (27), (81) and (82) in (83) and (84) and considering 
the asymptotic limit T — > oo, the two equations of geodesic deviation become. 



dX^ 



dx 



dx 



8a^ 



dx^ 



2a- 



dx 



+ a' 



32a^ 



A dx A 



56^ = 0, (85) 



Neglecting the exponentially decaying terms in 56^ in (85) and (86) and assuming 



(86) 



lim 

1" — yoo 



-ax 



d{5e^) 



dx 



= 0, lim 

X — ^oo 



'8a2 J(50i) 



dx 



= 0, lim 

X — >oo 



56' =0 



the geodesic deviation equations in (85) and ( 86) become. 



(87) 



J2(50i) d(56') . J d^(56^) d(56^) . , 

^ ^ +2a \ ^ +a^56^ = 0, — \^ + 2a \_^ +a^g0^ = O. (88) 



dx^ 



dx 



dx^ 



dx 



The consistency of the assumptions in (87) will be checked a posteriori after integrating 
equations in (88). It follows that the geodesies spread on is described by the 
temporal evolution of the following deviation vector components. 



1 



5^i{x) = {ai+a2x)e-"^ -:^a3e'^"^ + a4,5Gi{x) = {ai+a2x)e-"^ (S9) 
5ii2{x) = {a5+aex)e~'^'^ - ^aje^^'^'^ + as, 5o2{x) ^ {a5+a6x)e~"'^ 



(84) 



where at, i = 1,..., 8 are integration constants. Note that 04 and ag in (89) equal a(, in 
(66). Furthermore, note that these solutions above are compatible with the assumptions 
in (87). Finally, consider the Jacobi vector field intensity 7^^^ on ^s2-> 

J\ = i (^Mi)' + ;^ (^^1)' + i (^^2)' + 4 (5cT2)2 . (90) 

(7j <7j O2 O2 

Substituting (81), (82) and (89) in (90) and keeping the leading term in the asymptotic 
expansion in 7^ , we obtain 

•Z.^,, ~ C^./"'- (91) 

Ac? 

where the constant coefficient Cj^^ = = 2C encodes information about initial 

conditions and it depends on the model parameter a. We conclude that the geodesic 
spread on is described by means of an exponentially divergent Jacobi vector field 
intensity/^ 



5. STATISTICAL CURVATURE, JACOBI FIELD INTENSITY AND 

ENTROPY-LIKE QUANTITIES 

It is known that statistical manifolds allow differential geometric methods to be applied 
to problems in mathematical statistics, information theory and in stochastic processes. 
For instance, an important class of statistical manifolds is that arising from the so- 
called exponential family [8] and one particular family is that of gamma probability 
distributions. These distributions have been shown [19] to have important uniqueness 
properties for near-random stochastic processes. In this paper, two statistical manifolds 
of negative curvature and h^ve been considered. They are representations 
of smooth families of probability distributions (exponentials and Gaussians for ^^j, 
Gaussians for ^vj)- They represent the "arena" where the entropic dynamics takes place. 
The instability of the trajectories of the EDI and ED2 on and respectively, has 
been studied using the statistical weight (AV^^)^ defined on the curved manifold 
and the Jacobi vector field intensity J^^. Does our analysis lead to any possible further 
understanding of the role of statistical curvature in physics and statistics? We argue that 
it does. 

The role of curvature in physics is fairly well understood. It encodes information 
about the field strengths for all the four fundamental interactions in nature. The cur- 
vature plays a key role in the Riemannian geometric approach to chaos [20]. In this 
approach, the study of the Hamiltonian dynamics is reduced to the investigation of geo- 
metrical properties of the manifold on which geodesic flow is induced. For instance, the 
stability or local instability of geodesic flows depends on the sectional curvature prop- 
erties of the suitable defined metric manifold. The sectional curvature brings the same 
qualitative and quantitative information that is provided by the Lyapunov exponents in 
the conventional approach. Furthermore, the integrability of the system is connected 
with existence of Killing vectors on the manifold. However, a rigorous relation among 
curvature, Lyapunov exponents and Kolmogorov-Sinay entropy [21] is still under in- 
vestigation. In addition, there does not exist a well defined unifying characterization of 



chaos in classical and quantum physics [22] due to fundamental differences between the 
two theories. In addition, the role of curvature in statistical inference is even less un- 
derstood. The meaning of statistical curvature for a one-parameter model in inference 
theory was introduced in [23]. Curvature served as an important tool in the asymptotic 
theory of statistical estimation. The higher the scalar curvature at a given point on the 
manifold, the more difficult it is to do estimation at that point [24]. 

Recall that the entropy-like quantity S is the asymptotic limit of the natural logarithm 
of the average portion of the statistical volume (AV^J^ associated to the evolution of 
the geodesies on . Considering equations (52) and (80), we obtain, 

S2^2Si. (92) 



Furthermore, the relationship between the statistical curvatures on the curved manifolds 
and is, 

R^,^=2R^^^. (93) 

In view of (92) and (93), it follows that there is a direct proportionality between the cur- 
vature and the asymptotic expression for the entropy-like quantity S characterizing 
the ED on manifolds with / = 1,2, namely 

^ = ^. (94) 

Moreover, from (69) and (91), we obtain the following relation, 

J^s^'^^J^s,- (95) 

The two manifolds and are exponentially unstable and the intensity of Jacobi 
vector field J^^^ of manifold with curvature R^^^ — —2 is asymptotically twice 
the intensity of the Jacobi vector field J^^^of manifold ^^jWith curvature R = —I. 
Considering (93) and (95), we obtain 

^J^. (96) 

It seems there exists a direct proportionality between the curvature R^^ and the intensity 
of the Jacobi field characterizing the degree of chaoticity of a statistical manifold 
of negative curvature Finally, comparison of (94) and (96) leads to the formal link 
between curvature, entropy and chaoticity: 

R^Sr^J. (97) 

Though several points need deeper understanding and analysis, we hope that our work 

convincingly shows that this information-geometric approach may be useful in providing 
a unifying criterion of chaos of both classical and quantum varieties, thus deserving 
further research and developments. 



6. CONCLUSIONS 



Two entropic dynamical models have been considered: a 3D and 4D statistical manifold 
and respectively. These manifolds serve as the stage on which the entropic 
dynamics takes place. In the former case, macro-coordinates on the manifold are rep- 
resented by the expectation values of microvariables associated with Gaussian and ex- 
ponential probability distributions. In the latter case, macro-coordinates are expectation 
values of microvariables associated with two Gaussians distributions. The geometric 
structure of and .^V2 was studied in detail. It was shown that .^vi is a curved man- 
ifold of constant negative curvature —1 while has constant negative curvature —2. 
The geodesies of the ED models are hyperbolic curves on {i= 1,2). A study of 
the stability of geodesies on .^^ j and was presented. The notion of statistical vol- 
ume elements was introduced to investigate the asymptotic behavior of a one-parameter 
family of neighboring volumes (oc) = {K^, (t; Oc)}^- An information-geometric 
analog of the Zurek-Paz chaos criterion was presented. It was shown that the behavior 
of geodesies is characterized by exponential instability that leads to chaotic scenarios 
on the curved statistical manifolds. These conclusions are supported by a study based 
on the geodesic deviation equations and on the asymptotic behavior of the Jacobi vector 
field intensity on and ^S2- A Lyapunov exponent analog similar to that ap- 
pearing in the Riemannian geometric approach was suggested as an indicator of chaos. 
On the basis of our analysis a relationship among an entropy-like quantity, chaoticity 
and curvature in the two models EDI and ED2 is proposed, suggesting to interpret the 
statistical curvature as a measure of the entropic dynamical chaoticity. 

The implications of this work is twofold. Firstly, it helps understanding possible future 
use of the statistical curvature in modelling real processes by relating it to conventionally 
accepted quantities such as entropy and chaos. On the other hand, it serves to cast what 
is already known in physics regarding curvature in a new light as a consequence of its 
proposed link with inference. Finally we remark that based on the results obtained from 
the chosen ED models, it is not unreasonable to think that should the correct variables 
describing the true degrees of freedom of a physical system be identified, perhaps deeper 
insights into the foundations of models of physics and reasoning (and their relationship 
to each other) may be uncovered. 

Acknowledgements: The authors are grateful to Dr. A. Caticha for useful discussions. 



REFERENCES 

1. A. Caticha, "Entropic Dynamics", Bayesian Inference and Maximum Entropy Methods in Science 
and Engineering, ed. by R.L. Fry, AIP Conf. Proc. 617, 302 (2002). 

2. E. T. Jaynes, "Information Theory and Statistical Mechanics I", Phys. Rev. 106, 620 (1957); "Infor- 
mation Theory and Statistical Mechanics 11", Phys. Rev. 108, 171 (1957). 

3. A. Caticha, "Consistency and Linearity in Quantum Theory", Phys. Lett. A244, 13 (1998); "Consis- 
tency, Amplitudes and Probabilities in Quantum Theory", Phys. Rev. A57, 1572 (1998); "Probabihty 
and entropy in quantum theory". Maximum Entropy and Bayesian Methods, ed. by W. Von der Linden 
et al. (Kluwer, Dordrecht, 1999); "Insufficient reason and entropy in quantum theory". Found. Phys. 
30, 227 (2000). 

4. A. Caticha, "Towards a Statistical Geometrodynamics", Decoherence and Entropy in Complex Sys- 
tems, ed. by H.-T. Elze (Springer Verlag, 2004); "The Information Geometry of Space and Time", 



presented at the 25th International Workshop on Maximum Entropy and Bayesian Methods in Sci- 
ence and Engineering (San Jose, California, August 2005), (arXiv.org/abs/gr-qc/0508108). 

5. A. Caticha, "Maximum entropy and Bayesian data analysis: Entropic prior distributions", Physical 
Review E 70, 046127 (2004). 

6. A. Caticha, "Relative Entropy and Inductive Inference", Bayesian Inference and Maximum Entropy 
Methods in Science and Engineering, ed. by G. Erickson and Y. Zhai, AIP Conf. Proc. 707, 75 (2004), 
(arXiv.org/abs/physics/03 11093). 

7. A. Caticha and A. Giffin, "Updating Probabihties", presented at MaxEnt2006, the 26th In- 
ternational Workshop on Bayesian Inference and Maximum Entropy Methods (Paris, France), 
(arXiv:physics/0608 1 85). 

8. S. Amari and H. Nagaoka, Methods of Information Geometry, American Mathematical Society, 
Oxford University Press, 2000; S. Amari, "Differential-Geometric Methods in Statistics", vol. 28 
of Lecture Notes in Statistics, Springer- Verlag, 1985. 

9. R.A. Fisher, "Theory of statistical estimation", Proc. Cambridge Philos. Soc. 122, 700-725 (1925). 

10. C.R. Rao, "Information and accuracy attainable in the estimation of statistical parameters". Bull. 
Calcutta Math. Soc. 37, 81-91 (1945). 

11. N.N. Chentsov (Cencov), "Statistical Decision Rules and Optimal Inference", Transl. Math. Mono- 
graphs, vol. 53, Amer. Math. Soc. (Providence, RI, 1981). (Originally published in Russian, Nauka, 
Moscow, 1972). 

12. L. L. Campbell, "An extended Cencov characterization of the information metric", Proc. Am. Math. 
Soc. 98, 135 (1986). 

13. V.I. Arnold, Mathematical Methods of Classical Physics, Springer- Verlag New York Inc., 1989. 

14. W. H. Zurek and J. P. Paz, "Decoherence, Chaos, and the Second Law", Phys. Rev. Lett. 72, 2508 

(1994); "Quantum Chaos: a decoherent definition", Physica D 83, 300 (1995). 

15. J. P. Eckmann and D. Ruelle, "Ergodic theory of chaos and strange attractors". Rev. Mod. Phys. vol. 
57,617-656(1985). 

16. F. De Fehce and C. J. S. Clarke, Relativity on curved manifolds, Cambridge University Press 1990. 

17. C. W. Misner, K. S. Thome and J. A. Wheeler, Gravitation, Freeman & Co., San Francisco, 1973. 

18. C. Chicone and B. Mashhoon, "The generaUzed Jacobi equation". Class. Quantum Grav. 19 4231- 

4248 (2002). 

19. K. Arwini and C. T. J. Dodson, "Information geometric neighbourhoods of randomness and geometry 
of the Mckay bivariate gamma 3-manifold", Indian Journal of Statistics, vol. 66, 21 1-23 1 (2004). 

20. L. Casetti, R. Livi and, M. Pettini, "Gaussian Model for Chaotic Instability of Hamiltonian Flows", 
Phys. Rev. Lett. 74, 375-378 (1995); "Riemannian theory of Hamiltonian chaos and Lyapunov 
exponents", Phys. Rev. E 54, 5969-5984 (1996). 

21. T. Kawabe, "Indicator of chaos based on the Riemannian geometric approach", Phys. Rev. E 71, 
017201 (2005). 

22. C. M. Caves and R. Schack, "Unpredictability, Information, and Chaos", Complexity 3 (1), 46 (1997); 
A. J. Scott, T. A. Brun, C. M. Caves, and R. Schack, "Hypersensitivity and chaos signatures in the 
quantum baker's map", arXiv: quant-ph/0606102 (2006). 

23. B. Efron, "Defining the curvature of a statistical problem", Annals of Statistics 3, 1 189 (1975). 

24. C. C. Rodriguez, "Are we cruising a hypothesis space?" in Maximum Entropy and Bayesian Meth- 
ods, ed. by W. Von der Linden, V. Dose, R. Fischer and R. Press (Kluwer, Dordrecht, 1999). 



